
LU LU 




> 

01 

Oo 


Cd o 

o 




LU 



o 

CM 

q: 

LU 

=) 

CL 







CO 




CN 


CO 




CO 




CO 


LL 




LL 




LU 


1- 




h- 






z 








Z 













D CO 



< 
O 

h- 
Q. 
O 



LU 
> 

a: 

Q 



CO 
Q 
O 



LU ?T 



< 



CO 
CM 

LU 
> 

a: 

Q 



CM 



CO 

Q > 

< Q 





01 




LU 




EAK 


LO 


CL 









USER INTERFACE 101 



MICROPHONE 
100 



DISPLAY 47 



OTHER USER 
INPUT DEVICES 
40, 42 



SIGNAL 
PROCESSING 
(A/D) 102 



FEATURE 
EXTRACTOR 104 



SAPI 118 



APPLICATION 
120 



N-BEST 
ALTERNATIVES 
119 




1 



HYPOTHESIS 
LATTICE 116 AND 
REFERENCE 
PATH 117 



USER 
SELECTION 
INPUT 



FEATURE 
VECTOR 
105 



N-BEST 
ALTERNATIVE 
SUBPATH 
GENERATOR 124 



DECODER 106 



ACOUSTIC 
MODEL 112 



SR ENGINE 103 



LM110 



ACTIVE LEXICON 
108 



FIG. 2 



REFERENCE 
PATH 117 



HYPOTHESIS 
LATTICE 116 



LANGUAGE 
MODEL 110 



USER SELECTION 
INPUT 



BOUNDARY 
LOCATOR 200 



PATH EXTENDER 
202 



SCORE 
COMPUTATION 
COMPONENT 204 




PRIORITY 
QUEUE 1 
206 



H, SCORE 



H, SCORE 



PRIORITY 
QUEUE 2 
208 



H, SCORE 



H, SCORE 



CARC ARRAY 
210 



CARC 



CARC 



CARC 



CARC 




-BEST ALTERNATIVE SUBPATH 
ENERATOR 124 



OUTPUT 
COMPONENT 21 2 



FIG. 3A 



N-BEST 
ALTERNATIVES 



RECEIVE SPEECH DATA 


} 


f 



COMPUTE REFERENCE PATH AND 
HYPOTHESIS LATTICE 



250 



252 



FIG. 3B 



CARC OBJECT DATA STRUCTURE 



INDEX OF THIS OBJ IN CARC ARRAY 



WORD HYPOTHESIS INDEX 



PATH LENGTH 



INDEX OF PREV. CARC OBJ 



DICTIONARY WORD INDEX OF PRECED. WORD 



DICTIONARY WORD INDEX OF WORD 
PRECEDING THE PRECEDING WORD 



258 



PROVIDE REFERENCE PATH AND 
HYPOTHESIS LATTICE TO 
APPLICATION 



254 




FIG. 4A 



262 



LAUNCH APPLICATION 


1 


r 


RETRIEVE REFERENCE PATH AND 
HYPOTHESIS LATTICE 


26(/ 




} 




TRANSMIT REFERENCE PATH AND 
■ HYPOTHESIS LATTICE TO SR 
ENGINE 



0 



FIG. 4B 



RECEIVE USER 
SELECTION OF 
TEXT TO BE 
CORRECTED 



FIND BEGINNING 
BOUNDARY 
CONDITIONS 



FIND ENDING 
BOUNDARY 
CONDITIONS 




FIG. 5 



CONSTRUCT ALTERNATE 
SUBPATHS BY CONCATENATING 
WORDS IN THE HYPOTHESIS 
LATTICE THAT SATISFY BEGINNING 
AND ENDING BOUNDARY 
CONDITIONS 




FIND, IN THE HYPOTHESIS 
LATTICE, THE INSTANCE 

OF THE WORD 
PRECEDING THE USER- 
SELECTED TEXT IN THE 
REFERENCE PATH 



NOTE ITS BEGINNING 
TIME AS THE BEGINNING 
BOUNDARY 



SET THE BEGINNING 
BOUNDARY CONDITIONS 
TO INCLUDE AN 
INSTANCE OF THAT 
LEXICAL WORD THAT HAS 
THE SAME BEGINNING 
TIME 



FIND, IN THE HYPOTHESIS 
LATTICE, THE INSTANCE 
OF THE WORD IN THE 

REFERENCE PATH 
FOLLOWING THE USER- 
SELECTED TEXT 



RANK FINAL 
ALTERNATIVE 
SUBPATHS BY 
SCORE 



PRESENT TOPn 
SUBPATHS TO 
THE USER 




NOTE ITS ENDING TIME 
AS THE ENDING 
BOUNDARY 



276 



FIG. 6 



SET THE ENDING 
BOUNDARY CONDITIONS 
TO INCLUDE AN 
INSTANCE OF THAT 
LEXICAL WORD HAVING 
THE SAME ENDING TIME 



SELECT FROM THE HYPOTHESIS 
LATTICE AN INSTANCE OF THE 
BEGINNING WORD THAT SATISFIES 
THE BEGINNING BOUNDARY 
CONDITIONS TO BEGIN 
CONSTRUCTING A HYPOTHESIS 
ALTERNATE SUBPATH 



COMPUTE A SCORE FOR 
THIS HYPOTHESIS 
ALTERNATE SUBPATH 




CALCULATE ACTUAL SCORE BY 
ACCESSING HYPOTHESIS LATTICE FOR 
ACOUSTIC SCORE AND LM FOR LM 
SCORE AND ADDING THE ACOUSTIC 
AND LM SCORES FOR ALL WORDS IN 
THIS HYPOTHESIS ALTERNATE 
SUBPATH 



CALCULATE ESTIMATED SCORE BY 

TAKING A PROPORTION OF THE 
HYPOTHESIS ALTERNATE SUBPATH 
REMAINING TO BE CALCULATED TIMES 
THE SCORE FOR THE REFERENCE 
SUBPATH 



ADD THE ACTUAL AND ESTIMATED 
SCORES 



FIG. 8 



T 

SELECT A 
HYPOTHESIS 
ALTERNATE 
SUBPATH FROM THE 
FIRST QUEUE 



316 



314 



CHOOSE A NEXT WORD FROM THE 
HYPOHESIS U\TT!CE THAT HAS A STARTING 
TIME COINCIDENT WITH TTHE ENDING TIME 
OF THE PRECEDING WORD IN THE 
HYPOTHESIS ALTERNATE SUBPATH AND 
DOES NOT VIOLATE THE ENDING 
CONDITIONS 



318 



CONCATENATE THE CHOSEN 
WORD TO THE PREVIOUS WORD 
TO EXTEND THE HYPOTHESIS 
ALTERNATE SUBPATH 



M 320 



COMPUTE A SCORE FOR THE 
EXTENDED HYPOTHESIS 
ALTERNATE SUBPATH 



322 



''SECOND\NO 
QUEUE FULL 




326 



SORT SECOND 
QUEUE BY 
SCORE 



328 



NO 



DISCARD THIS 
HYPOTHESIS 
ALTERNATE 
SUBPATH 




^SCORE OF THE^ 
"EXTENDED HYPOTHESIS 
ALTERNATE SUBPATH > 
LOWEST SCORE IN SECOts 
QUEUE? 



332 



YES 



DELETE THE 
LOWEST 
SUBPATH FROM 
THE SECOND 

QUEUE 

^ 



330 



ADD THIS HYPOTHESIS 
ALTERNATE SUBPATH TO 
THE SECOND QUEUE 



324 



338 



342 




334 



SWITCH FIRS 
AND SECOND 
QUEUES 



34{ 



EXPAND THE 
BOUNDARY 
CONDITIONS 



SORT LAST 
QUEUE BY 
SCORE 



546 




348 



PERFORM ITN 



FIG 



PRESENT TOP n 
ALTERNATE 
SUBPATHS TO 
THE USER 



350 



